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Abstract: A new system is described for attaching many responsive graphical display consoles to a 


single multi-access central computer. 


The key component in this system is a new console, the 


GRAPHIC-2. The console includes a small general purpose computer and a specially designed dis- 


play processor. 


Only low bandwidth communication is required between the central computer and a 
console so a console can be located remotely and connected via a voice-grade line. 


Combined hard- 


ware-software solutions to problems of the console system are presented. 


INTRODUCTION 


Two pioneering systems, DAC-I (1) and 
Sketchpad (2), have demonstrated the effective- 
ness and desirability of graphical input-output 
computer communication via a cathode-ray tube 
display console. Since the advent of these sin- 
gle console systems, work has been going on to 
design configurations that allow an increased 
number of consoles to be attached to a large 
central computer, minimize the hardware and 
operating costs of each console, and allow re- 
mote location of consoles from the computer. 
The constraints generally applied to this work 
have been that a user at each console should 
possess at least the problem-solving power and 
response times to input device manipulations 
provided by the early systems. Under these 
constraints configuration design has indeed been 
difficult. 

An early configuration was the attachment of 
several consoles to a large time-shared com- 
puter (3,4). The CRT's were refreshed and 
console input devices were monitored by the 
computer. The direct connection of evena 
single console, however, caused excessive 
operating expense for picture refreshing. The 
time-sharing system provided slow responses 
to console input device manipulations. During 


- console usage, degradation of service to other 


computer system users also resulted (5). 

In a later configuration, multiple consoles 
were attached through a controller to a com- 
puter. The controller stored pictures received 
from the computer on a drum memory and re- 
freshed pictures without further computer aid. 
Console input devices were monitored by the 
computer. Dynamic subroutine loading and 
memory management were usedto allow several 
consoles to be served concurrently. With this 
organization, three consoles were successfully 
attached (6). However, for this number, total 
dedication of the computer was required, and 
actions at one console interfered with response 
times at others. Remote console location be- 
yond a few hundred feet from the computer was 
not possible. 

A third approach was to interpose a small 
general purpose computer between the central 
computer and the display console (7,8). The 
small computer, located at the display console, 
provided rapid responses to console input 


device manipulations and refreshed the picture 
out of its memory. It also accummulated work 
it could not perform for subsequent action by 
the central computer and supervised com- 
munications back and forth between the console 
and the central computer. The central com- 
puters were operated in batch mode with con- 
sole access between batch jobs. The size of 
the problem that could be solved at a console 
was usually limited by what could be contained 
in the console memory at onetime. For 
larger problems, the slow response to requests 
to update the console-contained piece of the 
problem made problem solving difficult. For 
these satellite systems, the central computer 
was totally dedicated during the batch slot 
allocated to a console so that high data trans- 
fer rates between the console and the central 
computer were desirable. Thus, these sys- 
tems had to be located close to the central 
computer to achieve reasonable communica- 
tions costs. 


THE GRAPHIC-2 SYSTEM ORGANIZATION 


Based on experience with the GRAPHIC-1 
console system (7) (which is of the type des- 
cribed in the previous paragraph) and on a rec- 
ognition of the problems of the other systems 
just outlined, a new display console system 
has been created. Specifically, the system 
consists of several satellite GRAPHIC-2 con- © 
soles attached to a large multi-access com- 
puter. Satisfactory performance is achieved 
with only voice-grade communication service 
(2000 baud) between the large computer and 
each console. Each console contains a small 
computer and a display; the configuration is 
shown in Fig. 1. The multi-access central 
computer currently is a GE 645 operating 
under the GECOS-II system. 

The overall cooperative operation of a 
GRAPHIC-2 console and the central computer 
can be summarized as follows: The central 
computer contains a structured data base 
which describes aproblem. The console 
computer also has a structured data base, the 
two data bases being similar though not 
identical. For example, greater precision in 
the storage of numbers and different linking 
conventions are used centrally. Separate 
programs reside in the central and console 
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Fig. 1 GRAPHIC-2 SYSTEM ORGANIZATION 


computers to deal with this structured informa- 
tion. These programs have been assembled 
from a single problem description. The pro- 
grams differ in detail but cooperate to execute 
the common problem. The operation of these 
programs is carefully interlocked. 

A user starts a problem by employing a 
bootstrap program to call for data and programs 
to be loaded from the central computer into the 
console core memory. Of course, if a problem 
is being formulated little or no initial data may 
exist. The user then employs the console input 
devices to work on his problem. Through an 


_interrupt-driven monitor, the console computer 


acts on signals received from the devices to 
direct control to appropriate servicing programs 
which quickly perform most manipulations on the 
data. The display immediately reflects these 
manipulations so that a user has rapid visual 
feedback of his actions. 

A history of console actions is transmitted 
to the central computer where the manipulations 
specified by the history are duplicated by the 
central computer program on the central data 
base. Because of this duplication, the history 
is highly encoded, i.e., it contains only end- 
point information of involved operations. A 
user has already received rapid response from 
the console computer, so there is generally no 
need for the central computer to act rapidly on 
this history. It can be transmitted to and pro- | 
cessed by the central computer in small blocks 
.as a problem is being worked on. Hence, much 
less information with less stringent response 
time demands passes from a GRAPHIC-2 con- 
sole to the central computer as compared with 
a directly coupled console to its supporting com- 
puter and low bandwidth transmission to the 
central computer is satisfactory. 


While the composition and editing of problem 
data can be easily handled by the console com- 
puter, large scale processing cannot. Large 
processing tasks, such as computing the fre- 
quency or time response of a circuit composed 
at the console, are directed to the central com- 
puter. The results of central computations are 
transmitted to the console for display aid/or 
further work. Since the large scale computa- 
tions usually take significant time, the extra de- 
lay caused by transmitting it over low bandwidth 
lines is not noticed by a console user (9). There- 
fore, low bandwidth communication is also 
satisfactory for transmission fo the console. 
Hence, a console can be located remotely and 
connected to the central computer via an eco- 
nomical dialed-up voice-grade line. 

The size of the memory in the GRAPHIC-2 
is limited. Therefore, provision is made to 
deal with an appropriate piece of a problem if 
the problem is too large to fit totally into the 
console at one time (10). The console thus rep- 
resents a dynamic window on a large problem 
surface. This dynamic quality is essential 
because, in man-computer problem solving, the 
course of action is man-directed (11). This 
course cannot be anticipated, so provision must 
be made for the problem to follow the man's 


directions. 
In review, the GRAPHIC-2 system operation 


is, in most cases, one of duplicate processing. 


Tasks requiring rapid response are done when- 
ever possible by the console computer. These 
same tasks are performed in the central com- 
puter, along with more complex tasks. So, 
remote console location with low bandwidth con- 
nection has been achieved at the expense of the 
duplicate processing. However, the console 
real-time tasks are treated in the central com- 
puter as blocked inputs without stringent re- 
sponse requirements. Multiple consoles are 
thus easily aid efficiently handled by a central 
computer with a minimum of interference to 
other central computer users. 

Let us now look at some problems which 
have required special consideration in the 
GRAPHIC-2 operation. As previously men- 
tioned, both the local computer and the cen- 
tral computer contain structured data bases. 
The ability to structure picture information is 
an absolute necessity in any display console. 

If names and hierarchical interrelations cannot 
be represented and manipulated, the console 
user is severely limited in the problems he 
can attack. It might be mentioned also that 
structured information goes hand-in-hand with 
organized user thought processes. Manipulat- 
ing and displaying structured information for a 
large problem is particularly difficult in a 
satellite console since memory space is lim- 
ited. 

A semi-interpetive mode of operation of the 
GRA PHIC-2 console which allows the direct 
display of the structured information is 
dependent upon special hardware features of 
the console. Before this mode is explained, 


therefore, the console hardware will be des- 
cribed. 


THE GRAPHIC-2 CONSOLE 


The GRAPHIC-2 console is a shared mem- 
ory multi-processor. One processor is that of 
a small general purpose computer; the other, 

a specially designed disolay processor. The 
computer, a D.E.C. PDP-9 (12), houses the 
8, 192 18-bit word memory which serves both 
processors. The PDP-9 has as staidard in- 
put devices a teletypewriter, a paper tape 
reader and punch, and a 60 Hz interrupt clock. 
The interrupt clock is used during light pen 
tracking aid for synchronizing frame repetit- 
ions. The other staidard devices are used 
only for bootstrapping, maintenance, and de- 
bugging. Options included on the computer are 
ai Extended Arithmetic Elemeat, a Direct 
Memory Access Channel Muttiplexor, and ai 
Automatic Priority Interrupt (API) system. 

The display processor controls a slightly 
modified D. E.C. Type 343 Slave CRT Disovlay. 
The method of picture formation is incremental 
point plotting on a 1024x1024 matrix. Lines 
aid characters are formed from closely spazed 
points. Thus, the disptay can be classed as a 
dot s2zope, as opposed to a stroke-vector scop 
in which lines are swept out. 

Console input devices area light pen, an 
ASCII-code keyboard (full seven-bit code), and 
eight pushbuttons. The selection of this set is 
based upon exerience obtained on the 
GRAPHIC-1 console. The small number of 
devices is possible becaus2, with a good pro- 

ramming system, the light penis extremely 
flexible. The display screen can be botha 
2ontrol and a display surface (13). Thus, the 


- light pen can serve both to indicate the flow of 


control when pointed at light buttons (control 
functions on the screen) or to supply arguments 
to any activated subprogram. A console is con- 
nected via a DATA-PHONE® Data Set 291A to 
the GE 645 system. 

The processor of the PDP-9 responds to 
input device signals to activate programs in the 
shared memory. In executing these programs, 
words are accessed from the memory, the 
operation code and arguments are interpreted, 
and the appropriate action such as an add, 
shift, etc. is performed. The display pro- 
cessor, through the memory multiplexor, has 
"cycle stealing" access to the memory with 
higher priority than the computer processor. 

It also accesses words from the memory, 
interprets the operation code and arguments, 
and performs the appropriate action. For the 
display processor these actions include dis- 
playing points, lines, and characters on the 
console CRT. 

The PDP-9 processor and the display pro- 


cessor can operate independently of one another. 


the PDP~-9 processor has control over the 
display, i.e., it can start and stop the display 
processor. One computer command loads the 
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contents of the azcumulator into the display 
address register of the display processor aid 
starts the display. Under internal controls, the 
display processor uses the display address reg- 
ister to sequence through display words from the 
shared memory. As each word is executed, the 
display address register is incremented aad the 
next word is fetched. Thus, the display address 
register performs the function of the program 
counter in a 1ormal computer. The execution 
of sequential words from memory is performed 
until the computer issues a stop command or 
uatil specially coded display words (display trap 
words) stop the cycling and signal the computer, 
This latter situatioa will be discussed in detail 
shortly. 

In addition to the information channel from 
the shared memory to the display processor, 
there is a path from the computer accumulator 
to the display processor. This path is remin- 
iscent of the only data path in some early dis- 


play scopes attached to computers. The 


instruction codes which are used in the direct 
memory access dath ave also used here. The 
accumulator-to-display path is under single step 
control, i.e., the display halts aid a signal is 
passed back to the computer when the accum- 
ulator-provided word has been completely ex- 
ecuted. The display address register is not 
changed during such actions, So, at the end 

of a string of words from the aztcumulator, a 
single command can restore normal cycling. 

The accumulator data nath may be used in 
setting and restoring the display status. It may 
a'so be used in performing interpretive function 
generation in which a display trap word stops 
normal cycling, interrupts the computer and 
provides functions generation a>zuments. The 
computer then uses the azcumulator path to 
generate the function. Circles, arcs, or 
other curves can be zenerated in this way with 
normal display cycling being resumed upon 
completion of the function. A data path from 
the display processor back to the computer 
accumulator is used to pass disolay processor 
status such as X and Y coordinates back to the 
computer. 

The display processor codes are shown in 
Fig. 2. In some previous consol2s, a bit 
configuration could mean different things de- 
pending on the display mode. This problem has 
been avoided by designing the display code sat 
with a separate operation code in each word. 
Thus, each display word is treated independ- 
ently and one can tell by merely examining a 
single word what operation it will perform. 

A leading '"'0'' bit categorizes the word as 
a display primitive. The primitives control 
the setting of display parameters, and the 
plotting of points, lines, and characters. 
Characters are formed utilizing a dot matrix 
approach. A specially designed character 
generator uses the computer memory to store 
a character font. The character code is com- 
bined with a pointer to address a dispatch 
table in the computer memory. The dispatch 
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Fig. 2. DISPLAY PROCESSOR CODES 


table entry is then used to access increment 
mode-like words which describe the character. 
A separate channel of the direct memory access 
multiplexor is employed. Double word buf- 
fering is used to minimize memory access 
waiting time. A user can compose and use any 
128 character font he desires. No basic char- 
acter grid is enforced although a 5x7 grid is 
normally used. The ASCTI font is available as 
a programmed standard. The core space re- 
quired by the ASCII font and dispatch table is 
456 words. 

-Parameter, absolute position, and incre- 
ment word functions are fairly standard.. One 
exception is the parameter word symmetry 
feature which transforms the up, down, right, 
and left movement commands from the vector, 
character, and increment generators. The 
first bit, E, exchanges the axes. If E is set, 
a right command becomes an up command, a 
left command becomes a down command, and 
vice versa. The second bit, Cy, complements 
the X direction movements. If set, it makes 
a right command into a left command and 


Pa 


vice versa. The stands for complement Y, 
and performs analdgous functions to. the Cy bit. 
Combinations of exchange and complement can 
be used to produce any of the symmetries of a 
square. 

Except for symmetry, the condition bits in 
the parameter word indicate whether the cor- 
responding current parameter value is changed 
or remains the same. For the symmetry feat- 
ure, a''l'' in the condition bit here functions as 
for the other parameters. A ''0" condition bit, 
however, means that the indicated symmetry 
transformation is concatenated with the current 
transformation to form anew symmetry trans- 
formation. For example, if a +90° rotation is 
already set, concatenation with a 180° rotation 
produces a +270° rotation. Thus, the symmet- 
ry feature functions properly for nested graph- 
ical subroutines. 

Several options are provided in the drawing 
of vectors. The holding register for the spec- 
ified component may be loaded only. The hold- 
ing register may be loaded and the vector, as 
specified by the current contents of both holding 
registers, drawn with or without beam inten- 
sification; both holding registers are cleared 
after vector execution. Alternately, the vector 
may be drawn with only the last point of the 
vector intensified. This option gives a relative 
point capability. a 

If the leading bit of a display wordis "1", 
the word is a display trap. Upon encountering 
a display trap word, the display processor 
stops and signals the console computer via the 
automatic priority interrupt. The second, 
third, and fourth bits of the display trap de- 
termine which of eight transfer pointers in an 
interrupt transfer vector is used to direct con- 
trolto aprogram. Thus, eight programs can 
be quickly evoked by display trap words. Other 
pointers in the interrupt transfer vector are 
activated by signals from the light pen, push- 
buttons, keyboard, data phone, and display 
processor. 

The display processor logic is presently 
running at 1 ysec per intensified dot in a line 
or character and 1/2 psec per unintensified dot, 
or off screen dot. Design improvements should 
allow reductions to 500 and 200 nsec, respect- 
ively. The present random point plot time of 
35 psec will also be reduced. 


EDGE VIOLATIONS 


A description of a large problem can be con- 
tained at a console. During work on the pro- 
blem, a console user may want to have only 
a small portion of the total picture fill the 
screen. He may want to move this area of in- 
terest, or window, smoothly about. During 
such actions, there may be picture pieces 
which are only partially contained on the CRT. 
It is particularly important in a satellite con- 
sole that edge violations from window move- 
ment be easily and appropriately handled. 
Extra space for a separate display list and 


cropping program and the processing of the 
total data base for every minute movement 
should not be necessary. Instead, edge vio- 
lations should be handled dynamically as they 
occur. 

The dynamic handling of physical edge 
violations is generally called ''scissoring."’ 
The common approach to achieve scissoring 
is to represent picture parts by incrementally 
specified lines, points, and characters. Then 
if these incremental movement commands 
cause a scope boundary to be crossed, the 
CRT beam is blanked until the boundary is 
crossed in the opposite direction, at which 
time the picture again is on the screen. Extra 
bits in the X and in the Y coordinate registers 
are used to detect scope edge violations (3, 
14,15). Dot intensification does not take place 
unless the extra bits in both coordinate reg- 
isters are all zero. A picture thus "wraps 
around" when only the least significant bits of 
the coordinate registers are considered but is 
intensified normally or totally blanked under 
control of the extra bits. Overflows or under- 
flows of the extra bits generate computer inter- 
rupts. Programs are then used to handle these 
situations. 

The edge-handling scheme used in 
GRAPHIC-2 is kindred to these techniques. 
Instead of extra bits in the coordinate regis- 
ters, however, a program settable switch de- 
termines whether the display is blanked or 
normal beam intensification takes place. The 
computer is signalled every time an edge is 
violated and sets the status of this override 
switch before resuming the display. This 
approach is less expensive in hardware than 
having extra register bits. Even with the extra 
bits approach, programming must be present 
for underflows or overflows of these. Always 
using this underflow-overflow type of pro- 
gramming makes for a consistent symmetrical 
approach. 

Two software registers are used to accum- 
ulate the edge violations, i.e., one register is 
incremented for each right edge violation and 
decremented for each left edge violation, and 
another register is used similarly for top and | 
bottom edge violations. The edge-handling 
routine determines if both registers are zero, 
and if so, the current point, line, or character 
being generated should appear on the screen. 

If not, the picture is off the screen. So the 


. scope hardware registers serve as the low- 


order ten bits of X and Y coordinate registers, 
the high-order bits of which are contained in 
software registers of any desired size. In 
practice, one 18-bit register for each axis has 
been set aside for the g extra bits, allowing 
scissoring over a 218x219 area, 


INTERPRETIVE OPERATION OF THE CONSOLE 
As previously emphasized, it is important 


to be able to display structured information 
locally. This is achieved in the GRAPHIC-2 
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system through intimate cooperation of the 
PDP-9 processor and the display processor. 
The display processor performs the primitive 
operation such as drawing points, lines, char- 
acters, and setting display parameters. The 
display trap words call upon the PDP-9 to per- 
form the control operations analogous to direct 
and subroutine transfers. 

One might argue that such extensive dem- 
ands should not be placed upon the PDP-9 in 
running the display. The computer should be 
free for handling other tasks. Also specialized 
hardware is generally faster than interpretive 
software so that more material might be dis- 
played flicker-free if hardware transfer were 
used. The specialized hardware approach is 
being taken with some current displays (14,15). 

Experience with the GRAPHIC-1 console has 
shown, however, that if not involved in running 
the display, the computer processor really is 
idle. On the other hand, using the computer 
processor to help in running the display reduces 
the complexity and cost of the display electron- 
ics, allows a hierarchical data structure to be 
displayed directly, and allows a pushdown stack 
of display structure to be maintained dynamic- 
ally, when appropriate, so that light pen strikes 
are "easily serviced. 

The amount of flicker-free picture that can 
be displayed is not significantly affected by inter- 
pretive operation since operation of the PDP-9 
processor and the display processor are over- 
lapped. To see how the structure level is 
dynamically traced in overlap operation, let 
us begin by considering Fig. 3 
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Fig. 3. 


- Here, a typical picture structure as used in 


GRAPHIC-2 is illustrated (10). Thisisa 
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directed graph structure in which there are sev- 
eral types of entities. The circles represent 
nodes; the straight lines with arrows, branches; 
and the squares, terminal nodes or leaves. The 
nodes represent particular subparts of a pic- 
ture. The branches are references to lower- 
level subparts of the picture. By convention, 
only the leaves contain displayable material 
which is represented in display processor code 
formats. The related data structure in the 
central computer also conforms to the con- 
straint of having displayable material only in 
the leaves, although this information is not 
represented by display codes. So nodes and 
branches represent structure; leaves, picture 
elements. Display is accomplished as follows. 
The console computer traces down from the 
display node which heads each picture until it 
reaches a leaf. The display processor is 
started on displaying the leaf. In the mean- 
time, the console computer traces through the 
structure to find the next leaf. Position offsets 
between leaves are added up digitally during 
the structure tracing. When the display pro- 
cessor hits the display trap word marking the 
end of a leaf, the computer processor senses 
this and sets the display to the starting 
position of the leaf, gives the display processor 
the place in memory where the new leaf is 
located, and restarts the display. The console 
computer now traces through the structure to 
locate the next leaf, etc. If a light-pen hit 
occurs during a display frame, the console 
computer ceases overlap operation during the 
next frame and instead dynamically maintains 
a pushdown list of the path structure, updating 
this list between leaves. When a light-pen hit 
occurs in this frame, the complete structure 
path name leading to that leaf is immediately 
available. Overlap operation is resumed on 
the next frame. 

The light pen can be used to point at a 
particular leaf in the picture structure. Pro- 
gramming techniques are used to blink the 
selected leaf or higher levei structures con- 
taining the leaf. The place in the data 
structure of the currently considered leaf is 
thus made apparent to auser. This type of 
visual feedback has proven valuable, if not 
essential, both in the GRAPHIC-2 and else- 
where (16). 

During overlap operation, the structure 
tracing for a new leaf is often finished well 
before the display of the previous leaf. There- 
fore, a minimum of time is needed to start 
the display processor on a new leaf. Extra 
time is required only during a light-pen inter- 
pretation frame. Contrast the interpretive 
mode to the operation of fixed hardware which 
must take the time for all the structure tracing 
‘and additicn of position offsets in series with 
display time eachframe. For heavily struct- 
ured displays, the gains of overlapped inter- 
pretive operations can be significant. 

Aside from handling leaf ends, display 
trap programs are used to perform data- 


structure manipulations every display regen- 
eration cycle. Examples of this type of pro- 
gram are a ''move'' program to cause an 

object on the CRT to follow the light pen, and 

a "rubber-band line’ drawing program. Another 
use is function generation using the accumulator 
path as outlined earlier. Still other uses are to 
change the character table pointer so that sev- 
eral character fonts appear in a picture and to 
implement the carriage return character fun- 
ction. 


COMMENTS 


Although in the GRAPHIC-2 software system 
the display handling proceeds without the exact 
software duplication of current hardware tech- 
niques, there is nothing to prevent such use. 
The display trap programs could easily perform 
conventional direct transfers and subroutine 
transfers and return (with status saving and 
restoring) or any other operations. Other 
software systems might employ the flexibility 
and power of display trap techniques in as yet 
unconceived ways. The ability provided by dis- 
play trap words to cause console computer 
programs to be executed at speCified places 
in the display cycle is another step in the con- 
tinuing development of more powerful display 
techniques. These techniques began with 
displays run from lists through the computer 
accumulator, moved to linear lists out of a 
channel, then to hardware subroutining, and 
now to extensive intermixed programming. 

The satellite console organization seems to 
be finding increasing favor, Older console 
systems are being modified (17), the large 
suppliers are joining some standard pieces 
to form such a system (18,19), and entirely new 
consoles (20) and systems (21) are being de- 
signed. It is hoped that the ideas being pione- 
ered by the GRAPHIC-2 system will be useful 
in these new systems. 
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